View MT9V128D00XTCK22BC1-200_9020685.PDF datasheet online --- IC-ON-LINE

Datasheet File OCR Text:

mt9v128:1/4-inch color cmos ntsc/pal digital image sensor features ? mt9v128_ds rev. f pub. 5/15 en 1 ?semiconductor components industries, llc 2015, 1/4-inch color cmos ntsc/pal digital image soc with distortion correction and overlay processor mt9v128 datasheet, rev. f for the latest datasheet, please visit www.onsemi.com features ? low-power cmos image sensor with integrated image flow processor (ifp) and video encoder ? 1/4-inch optical format, vga resolution (640h x 480v) ? 2.5% additional columns and rows to compensate for lens alignment tolerances ? integrated lens distortion correction ? overlay generator for dynamic bitmap overlay ? integrated video encoder for ntsc/pal with overlay capability and 10-bit i-dac ? integrated microcontroller for flexibility ? on-chip image flow processor performs sophisticated processing, such as color recovery and correction, sharpening, gamma, lens shading correction, on-the-fly defect correction, auto white balancing, and auto exposure ? auto black level calibration ? 10-bit, on-chip analog-to-digital converter (adc) ? internal master clock generated by on-chip phase- locked loop (pll) ? two-wire serial programming interface ? interface to low-cost flash through spi bus ? high-level host command interface ? stand alone operation support ? comprehensive tool support for overlay generation and lens correction setup ? development system with devware ? overlay generation and compilation tools applications ? automotive rearview camera and side mirror ? blind spot and surround view key parameters are continued on next page. see details of new features on page 3. see ?ordering information? on page 3. table 1: key parameters parameter typical value pixel size and type 5.6 ? m x 5.6 ? m active pinned- photodiode with high-sensitivity mode for low-light conditions sensor format 680h x 512v (includes 2.5% of rows and columns for lens alignment) ntsc output 720h x 480v pal output 720h x 576v imaging area total array size: 3.584 mm x 2.688 mm optical format ?-inch frame rate 50/60 fields/sec sensor scan mode progressive scan color filter array rgb standard bayer shutter type electronic rolling shutter (ers) automatic functions exposure, white balance, black level offset correction, flicker avoidance, color saturation control, on-the-fly defect correction, aperture correction programmable controls exposure, white balance, horizontal and vertical blanking, color, sharpness, gamma correction, lens shading correction, horizontal and vertical image flip, zoom, windowing, sampling rates, gpio control lens distortion correction 1 maximum lens distortion supported up to 25% flexible algorithm that can be calibrated for many wide-angle lenses through software tools perspective correction
mt9v128_ds rev. f pub. 5/15 en 2 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor applications notes: 1. lens distortion correction and graphical ov erlay is available only in ccir656 output format. 2. analog output enabled; parallel output disabled. table 2: key parameters (continued) parameter typical value overlay support 1 utilizes spi interface to load overlay data from external flash/eeprom memory with the following features: ?overlay size 360 x 480 pixel rendered into 720 x 480 pixel display format ?up to four (4) overlays may be blended simultaneously ?selectable readout: rotating order user selected ?dynamic scenes by loading pre-re ndered frames from external memory ?palette of 32 colors out of 64,000 ?8 colors per bitmap ?blend factor dynamically programmable for smooth transitions ?fast update rate of up to 30 fps ?every bitmap object has independent x/y position ?statistic engine to calibrate optical alignment ?number generator external overlay processing support digital input to on-chip ntsc encoder allows for external overlay, processing by a dsp, or fpga windowing programmable to any size max analog gain 0.5C16x adc 10-bit, on-chip output interface analog composite video out, single-ended or differential; 8-, 10-bit parallel digital output output data formats 1 digital: raw bayer 8-,10-bit, ccir656, 565rgb, 555rgb, 444rgb data rate parallel: 27 mb/s ntsc: 60 fields/sec pal: 50 fields/sec control interface two-wire i/f for register interface plus high-level command exchange. spi port to interface to external memory to load overlay data, register settings, or firmware extensions. input clock for pll 27 mhz spi clock frequencies 4.5 - 9.0 - 18 mhz, programmable supply voltage analog: 2.8 v 5% core: 1.8 v 5% io: 2.8v 5% power consumption full resolu tion at 60 fps: <350mw 2 package 63-bga, 9mm x 9mm, 1mm pin pitch ambient temperature operating: C40c to 105c functional: C40c to +85c storage: C50c to +150c dark current < 200e/s at 60c with a gain of 1 fixed pattern noise column < 2% row < 2% responsivity 16.5 v/lux-s at 550nm signal to noise ratio (s/n) 46 db pixel dynamic range 74.8 db
mt9v128_ds rev. f pub. 5/15 en 3 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor new features new features integrated lens distortion correction ? eliminates expensive dsp for image correction ? can be calibrated for wide-angle lenses of up to 180 degree horizontal fov (field of view) ? distortion correction for up to 25% distortion in fov ? perspective correction ? view from elevated angle integrated video encoder for pa l/ntsc with overlay capability ? composite analog output (ntsc/pal) ? 8-bit parallel digital output itu-r bt.656 format ? raw bayer format ? digital input to on-chip ntsc encoder to allow additional proc essing functions by external dsp or fpga on-chip overlay generator ? static and dynamic overlay graphics with four overlay planes plus number plane ? support for serial spi memory up to 16 megabytes ?number generator ? overlay blending and x/y positioning ? overlay position adjustment and stat istics engine to calibrate overlay ? overlay support utilizes spi interface to load overlay data from external serial flash/eeprom to supp ort the following features: ? overlay size 360 x 480 pixel rendered into 720 x 480 pixel display format ? up to four overlays may be blended simultaneously ? selectable readout: rota ting order user selected ? dynamic scenes by loading pre-rendered frames from external memory ? palette of 32 colors out of 64,000 ? eight colors per bitmap ? blend factor dynamically programmable for smooth transitions ? fast update rate of up to 30 fps ? every bitmap object has independent x/y position ? statistics engine to calibrate optical alignment ? external overlay processing supports digi tal input to on-chip ntsc encoder; this enables external overlay processing by a dsp or fpga ordering information table 3: available part numbers part number product description orderable product attribute description MT9V128D00XTCK22BC1-200 vga 1/4" soc die sales, 200 ? m thickness mt9v128ia3xtc-dp vga 1/4" soc dry pack with protective film mt9v128ia3xtc-dr vga 1/4" soc dry pack without protective film mt9v128ia3xtc-tp vga 1/4" soc tape & reel with protective film
mt9v128_ds rev. f pub. 5/15 en 4 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor ordering information mt9v128ia3xtc-tr vga 1/4" soc tape & reel without protective film table 3: available part numbers part number product description orderable product attribute description
mt9v128_ds rev. f pub. 5/15 en 5 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor table of contents table of contents features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 new features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3 ordering information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3 general description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 system block diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 pin descriptions and assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 soc description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 sensor pixel array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 usage modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30 external overlay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32 multicamera support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33 external signal processing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 slave two-wire serial interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44 integrated lens distortion correction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 overlay capability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53 serial memory partition. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54 overlay adjustment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55 overlay character generator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57 modes and timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 electrical specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .76 spectral characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .86 revision history. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .88
mt9v128_ds rev. f pub. 5/15 en 6 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor list of figures list of figures figure 1: internal block diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 figure 2: system block diagram. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 figure 3: using a crystal instead of an external oscillator. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 figure 4: sensor core block diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 figure 5: pixel array description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 figure 6: image capture example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19 figure 7: sensor pixel array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 figure 8: pixel color pattern detail (top right corner) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 figure 9: spatial illustration of image re adout. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21 figure 10: color pipeline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22 figure 11: color bar test pattern . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23 figure 12: color bars . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24 figure 13: gamma correction curve. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27 figure 14: auto-config mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30 figure 15: flash mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30 figure 16: usage mode 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31 figure 17: host mode with flash . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31 figure 18: host mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31 figure 19: external overlay system block di agram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32 figure 20: multicamera system block diagra m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33 figure 21: external signal processing bloc k diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 figure 22: power-up sequence ? configuration options flow chart . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36 figure 23: interface structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38 figure 24: single read from random locati on . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46 figure 25: single read from current location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46 figure 26: sequential read, start from rand om location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 figure 27: sequential read, start from curre nt location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 figure 28: single write to random location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 figure 29: sequential write, start at rand om location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 figure 30: barrel distortion definition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 figure 31: vertical perspective adjustment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51 figure 32: conversion sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52 figure 33: overlay data flow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53 figure 34: memory partitioning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54 figure 35: overlay calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56 figure 36: internal block diagram overlay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57 figure 37: example of character descriptor 0 stored in rom. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58 figure 38: full character set for overlay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59 figure 39: single-ended termination . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 figure 40: differential connection?grounded termination . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61 figure 41: ccir656 8-bit parallel interfac e format for 525/60 (625/50) video systems . . . . . . . . . . . . . . . . . . . .61 figure 42: typical ccir656 vertic al blanking intervals for 525/60 video system. . . . . . . . . . . . . . . . . . . . . . . . . .62 figure 43: typical ccir656 vertic al blanking intervals for 625/50 video system. . . . . . . . . . . . . . . . . . . . . . . . . .63 figure 44: parallel input data timing waveform using d in _clk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .64 figure 45: primary clock relationships . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .65 figure 46: typical i/o equivalent circuits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .67 figure 47: ntsc block . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .68 figure 48: serial interface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .68 figure 49: digital output i/o timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69 figure 50: slew rate timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70 figure 51: configuration timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .71 figure 52: power up sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72 figure 53: power down sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73 figure 54: frame_sync to frame_valid/line_v alid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73 figure 55: reset to spi access delay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .74 figure 56: reset to serial access delay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .74
mt9v128_ds rev. f pub. 5/15 en 7 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor list of figures figure 57: reset to ae/awb image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .74 figure 58: spi output timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .76 figure 59: video timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .82 figure 60: equivalent pulse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .83 figure 61: v pulse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84 figure 62: two-wire serial bus timing parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85 figure 63: quantum efficiency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .86 figure 64: 63-ball ibga package outline dr awing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .87
mt9v128_ds rev. f pub. 5/15 en 8 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor list of tables list of tables table 1: key parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 table 2: key parameters (continued). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 table 3: available part numbers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3 table 4: pin descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 table 5: pin assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 table 6: reset/default state of interfaces. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 table 7: eia color bars (ntsc) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24 table 8: ebu color bars (pal). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24 table 9: ntsc . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24 table 10: pal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 table 11: ycbcr output data ordering. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 table 12: rgb ordering in default mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 table 13: 2-byte bayer format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 table 14: spi flash devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36 table 15: spi commands supported . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37 table 16: gpio bit descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37 table 17: system manager commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40 table 18: overlay host commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40 table 19: dewarp commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41 table 20: gpio host commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41 table 21: flash manager host commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41 table 22: sequencer host commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 table 23: tx manager host commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43 table 24: two-wire interface id address switching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44 table 25: lens correction features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 table 26: transfer time estimate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54 table 27: character generator details. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59 table 28: field, vertical blanking, eav, an d sav states 525/60 video system . . . . . . . . . . . . . . . . . . . . . . . . . . . .62 table 29: field, vertical blanking, eav, an d sav states for 625/50 video system . . . . . . . . . . . . . . . . . . . . . . . . . 63 table 30: parallel input data timing values using d in _clk. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .64 table 31: output data ordering in d out rgb mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66 table 32: output data ordering in sensor stand-alone mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66 table 33: parallel digital output i/o timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69 table 34: slew rate for pixclk and d out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70 table 35: configuration timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .71 table 36: power up sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72 table 37: power down sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73 table 38: frame_sync to frame_valid/line_val id parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .74 table 39: reset_bar delay parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .75 table 40: spi data setup and hold timing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .76 table 41: absolute maximum ratings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .77 table 42: electrical characteristics and oper ating conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .77 table 43: video dac electrical characteristics?single-ended mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .78 table 44: video dac electrical characteristics?differential mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .78 table 45: digital i/o parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .79 table 46: power consumption ? condition 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .80 table 47: power consumption ? condition 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .80 table 48: ntsc signal parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .81 table 49: video timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .82 table 50: equivalent pulse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .83 table 51: v pulse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84
mt9v128_ds rev. f pub. 5/15 en 9 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor list of tables table 52: two-wire serial bus characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
mt9v128_ds rev. f pub. 5/15 en 10 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor general description general description the on semiconductor mt9v128 is a vga- format, single-chip cmos active-pixel digital image sensor for automotive applications. it captures high-quality color images at vga resolution and outputs ntsc or pal interlaced composite video. the vga cmos image sensor features on semiconductor?s breakthrough low-noise cmos imaging technology that achieves ne ar-ccd image quality (based on signal-to- noise ratio and low-light sensitivity) whil e maintaining the inherent size, cost, low power, and integration advantages of on se miconductor's advanced active pixel cmos process technology. the mt9v128 is a complete camera-on-a-chip. it incorporates sophisticated camera functions on-chip and is progra mmable through a simple two-wi re serial interface or by an attached spi flash memory that contains setup information that may be loaded auto- matically at startup. the mt9v128 performs sophisticated processing functions including color recovery, color correction, sharpening, programmable gamma correction, auto black reference clamping, auto exposure, 50hz/ 60hz flicker avoidance, lens shading correction, auto white balance (awb), and on-the-fly defect identification and correction. the mt9v128 outputs interlaced-scan images at 30 or 25 fps, supporting both ntsc and pal video formats. the image data can be output on one or two output ports: ? composite analog video (single-end ed and differential output support) ? parallel 8-, 10-bit digital the integrated lens correction and overlay generation for steering guidance eliminates expensive overlay processing that is usually required by an external dsp; this signifi- cantly reduces overall costs.
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor architecture mt9v128_ds rev. f pub. 5/15 en 11 ?semiconductor components industries, llc,2015. architecture internal block diagram figure 1: internal block diagram note: the active array is smaller than the sensor array. image flow processor color & gamma correction color space conversion edge enhancement camera control awb ae overlay graphics generation ? vga roi @ 60 frames per sec. 640 x 480 active array videoencoder dac spi & 2 w i/f interface spi 4 2 8 8 10 ntsc / pal bt -656 optional bt -656 input 2. 8v 1.8v two-wire i/f lens correction
mt9v128_ds rev. f pub. 5/15 en 12 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor system block diagram system block diagram the system block diagram will depend on th e application. the system block diagram in figure 2 shows all components; optional peripheral components are highlighted. control information will be received by a microcontroller through the automotive bus, such as lin or can bus, to communicate with the mt9v128through its two-wire serial bus. optional components will vary by application. for further details, see the mt9v128 register and variable reference. figure 2: system block diagram spi serial data flash 10kb - 16mb lp filter 27 mhz dac _pos c 2wire i/f composite video pal /ntsc v aa (2.8v) vaa _pix (2.8v ) v dd (1.8v) extclk system bus can /lin 4.7k dac_ref 2.8v dac _neg ldo v dd _io (2.8v) . ccir 656/ gpo ccir 656/ or gpi optional xtal 75 v dd _pll (2.8v) . v dd _dac (2.8v) reset_bar frame _sync pixclk frame_valid line_valid d in _cl k d in [7:0] d out _ lsb0,1 d out [7:0]
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor system block diagram mt9v128_ds rev. f pub. 5/15 en 13 ?semiconductor components industries, llc,2015. crystal usage as an alternative to using an external osci llator, a fundamental 27 mhz crystal may be connected between extclk and xtal. two small loading capacitors of 15?22pf of npo dielectric should be added as shown in figure 3. on semiconductor does not recommend using the crystal option for automotive appli- cations above 85 c. a crystal oscillator with temperature compensation is recom- mended. figure 3: using a crystal instead of an external oscillator when using xtal as the clock source, the intern al inverter circuit has a 100k bias resistor in parallel to xtal, which can be connected or disconnected by register 0x0014 bit[14]. the clockin_bias_en bit is set to 1 by default. extclk xtal 18 pf - npo 27.000 mhz sensor 18 pf - npo
mt9v128_ds rev. f pub. 5/15 en 14 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor pin descriptions and assignments pin descriptions and assignments table 1: pin descriptions pin number pin name type description clock and reset b1 extclk input master input clock (27mhz): this can either be a square-wave generated from an oscillator (in which case the xtal input must be left unconnected) or connected directly to a crystal. b2 xtal output if extclk is connected to one pin of a crystal, this signal is connected to the other pin; otherwise this signal must be left unconnected. c1 reset_bar input asynchronous active-low rese t: when asserted, the device will return all interfaces to their reset state. when re leased, the device w ill initiate the boot sequence. c2 frame_sync input this input can be used to set the output timing of the mt9v128 to a fixed point in the frame. the input buffer associated with this input is permanently enabled. this signal should be connected to gnd if not used. register interface g3 sclk input these two signals implement serial co mmunications protocol for access to the internal registers and variables. h3 s data input/od h2 s addr input this signal controls the device id that will respond to serial communication commands. two-wire serial interface device id selection: 0: 0x90 1: 0xba spi interface h5 spi_sclk output clock output for interfacin g to an external spi memory such as flash/ eeprom. tristate when reset_bar is asserted. g5 spi_sdi input data in from spi device. this signal has an internal pull-up resistor. h4 spi_sdo output data out to spi device. tristate when reset_bar is asserted. g4 spi_cs_n output chip selects to spi device. tristated when reset_bar is asserted. (parallel) pixel data input d1 d in _clk input pixel clock input: data on d in [7:0] are sampled at the rising or falling edge of this clock. (alternatively, an internal sampling clock may be used.) h1, g1, f1, g2, f2, e1, e2, d2 d in [7:0] input data coming in on this interface is passed through the overlay blender and to the video encoder output. the input buffers associated with inputs 7 to 0 are powered down by default. this allows these signals to be left unconnected if not required. these inputs can also be used as general purpose inputs. (parallel) pixel data output e7 frame_valid input/output pixel data from the mt 9v128 can be routed out on this interface and processed externally. to save power, these signals are driven to a constant logic level unless the parallel pixel data output or alternate (gpio) function is enabled for these pins. for more information see table 16 on page 28. this interface is disabled by default. the slew rate of these outputs is programmable. these signals can also be used as general purpose input/outputs. e6 line_valid input/output e8 pixclk output c7, b6, c8, b7, b8, a6, a7, a8 d out [7:0] output
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor pin descriptions and assignments mt9v128_ds rev. f pub. 5/15 en 15 ?semiconductor components industries, llc,2015. d7 d out _lsb1 input/output when the sensor core is running in by pass mode, it will generate 10 bits of output data per pixel. these two pins make the two lsb of pixel data available externally. leave unconnected if not used. to save power, these signals are driven to a constant logic le vel unless the sensor core is running in bypass mode or the alternate function is enabled for these pins. for more information see table 16, gpio bit descriptions, on page 28. this interface is disabled by default. the slew rate of these outputs is programmable. d8 d out _lsb0 input/output composite video output b3 dac_pos output positive video dac output in differential mode. video dac output in single-ended mode. this interface is enabled by default using ntsc/pal signalling. for applications where composite video output is not required, the video dac can be placed in a power-down state under software control. a4 dac_neg output negative video dac output in differential mode. connect to a gnd in single- ended mode. a2 dac_ref output external reference resistor for the video dac. manufacturing test interface d6 tdi input jtag test pin (reserved for test mode) c6 tdo output jtag test pin (reserved for test mode) f3 tms input jtag test pin (reserved for test mode) f4 tck input jtag test pin (reserved for test mode) f5 trst_n input connect to gnd. f6 atest1 input analog test input. connect to gnd in normal operation. g6 atest2 input analog test input. connect to gnd in normal operation. power c3, d3, e3 v dd supply supply for v dd core: 1.8v nominal. c5, d5, e5 v dd _io supply supply for digital ios: 2.8v nominal. a5 v dd _dac supply supply for video dac: 2.8v nominal. b5 v dd _pll supply supply for pll: 2.8v nominal. g7, g8 v aa supply analog power: 2.8v nominal. f7, f8 v aa _pix supply analog pixel array power: 2.8v nomina l. must be at same voltage potential as v aa . a3 gnd_dac supply video dac ground b4, c4, d4, e4 d gnd supply digital ground. h6, h7, h8 a gnd supply analog ground. table 1: pin descriptions (continued) pin number pin name type description
mt9v128_ds rev. f pub. 5/15 en 16 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor pin descriptions and assignments pin assignments pin 1 is not populated with a ball. that allows the device to be identified by an additional marking. table 2: pin assignments 1 2 3 4 5 6 7 8 a dac_ref gnd_dac dac_neg v dd _dac d out 2d out 1d out 0 bextclk xtal dac_pos gnd v dd _pll d out 6d out 4d out 3 c reset_bar frame_sync v dd gnd v dd _io tdo d out 7d out 5 dd in _clk d in 0v dd gnd v dd _io tdi d out _lsb1 d out _lsb0 ed in 2d in 1v dd gnd v dd _io line_valid frame_valid pixclk fd in 5d in 3tmstcktrst_natest1v aa _pix v aa _pix gd in 6d in 4 sclk spi_cs_n spi_sdi atest2 v aa v aa hd in 7s addr s data spi_sdo spi_sclk a gnd a gnd a gnd table 3: reset/default state of interfaces name reset state default state notes extclk clock running or stopped clock running input xtal n/a n/a input reset_bar asserted de-asserted input sclk n/a n/a input. must always be driven to a valid logic level. s data high impedance high impedance input/output. a valid logic level should be established by pull-up resistor. s addr n/a n/a input. must always be driven to a valid logic level. must be permanently tied to v dd _io or gnd. spi_sclk high impedance. driven, logic 0 output. output enable is r0x0032[9]. spi_sdi internal pull-up enab led. internal pull-up enabled input. internal pull-up is permanently enabled. spi_sdo high impedance driven, logic 0 output enable is r0x0032[9]. spi_cs_n high impeda nce driven, logic 1 output enable is r0x0032[9]. d in clk input buffer powered down input buffer powered down input. this interface is disabled by default, and the input buffers are powered down. if this interface is not required, these pins can be left unconnected (floating). d in 7 d in 6 d in 5 d in 4 d in 3 d in 2 d in 1 d in 0
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor pin descriptions and assignments mt9v128_ds rev. f pub. 5/15 en 17 ?semiconductor components industries, llc,2015. notes: 1. the reason for defining the default state as lo gic 0 rather than high impedance is this: when wired in a system (for example, on our demo boards), these outputs will be connected, and the inputs to which they are connected will want to see a valid lo gic level. no current drain should result from driving these to a valid logi c level (unless there is a pull-up at the system level). 2. these pads have their input circuitry powered down, but they are not output-enabled. therefore, they can be left floating but they will not dr ive a valid logic level to an attached device. frame_valid high impedance high impedance input/output. this interface disabled by default. input buffers (used for gpio function) powered down by default, so these pins can be left unconnected (floating). after reset, these pins are powered up, sampled, then powered down again as part of the auto- configuration mechanism. see note 2. line_valid pixclk high impedance driven, logic 0 output. this interface disabled by default. see note 1. d out 7 d out 6 d out 5 d out 4 d out 3 d out 2 d out 1 d out 0 d out _lsb1 high impedance high impedance input/output. this interface disabled by default. input buffers (used for gpio function) powered down by default, so these pins can be left unconnected (floating). after reset, these pins are powered-up, sampled, then powered down again as part of the auto- configuration mechanism. d out _lsb0 high impedance driven, logic 0 dac_pos high impedance driven output. interface disabled by hardware reset and enabled by default when the device starts streaming. dac_neg dac_ref tdi internal pull-up enabled internal pull-up enabled input. internal pull-up me ans that this pin can be left unconnected (floating). tdo high impedance high impedance output. driven only during appropriate parts of the jtag shifter sequence. tms internal pull-up enabled internal pull-up enabled input. internal pull-up me ans that this pin can be left unconnected (floating). tck internal pull-up enabled internal pull-up enabled input. internal pull-up me ans that this pin can be left unconnected (floating). trst_n n/a n/a input. must always be driven to a valid logic level. must be driven to gnd for normal operation. frame_sync n/a n/a input. must always be driven to a valid logic level. must be driven to gnd for normal operation. atest1 must be driven to gnd for normal operation. atest2 must be driven to gnd for normal operation. table 3: reset/default state of interfaces (continued) name reset state default state notes
mt9v128_ds rev. f pub. 5/15 en 18 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor soc description soc description detailed architecture overview sensor core the sensor consists of a pixel array, an analog readout chain, a 10-bit adc with programmable gain and black offset, and timing an d control as illustrated in figure 4. figure 4: sensor core block diagram pixel array structure the sensor core pixel array is configured as 744 columns by 512 rows, as shown in figure 5. this includes black rows and columns. figure 5: pixel array description the black row data are used internally for the automatic black level adjustment. however, these black rows can also be read ou t by setting the sensor to raw data output mode. there are 744 columns by 512 rows of opti cally-active pixels that include a pixel boundary around the vga (640 x 480) image to avoid boundary effects during color interpolation and correction. communication bus to ifp 10-bit data to ifp sync signals clock control register analog processing active pixel sensor (aps) array timing and control adc active border rows black row black rows black columns black columns active border rows active border columns active border columns active pixel array 640 x 480 (not to scale) pixel logical address = (743, 511) pixel logical address = (0, 0)
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor soc description mt9v128_ds rev. f pub. 5/15 en 19 ?semiconductor components industries, llc,2015. the one additional active column and two a dditional active rows are used to enable horizontally and vertically mirrored re adout to start on the same color pixel. figure 6 illustrates the process of capturing the image. the original scene is flipped and mirrored by the sensor optics. sensor readou t starts at the lower right corner. the image is presented in true orientation by the output display. figure 6: image capture example scene (front view) optics image capture image rendering start readout row by row image sensor (rear view) start rasterization process of i ma g e gatherin g and im age displa y display (front view)
mt9v128_ds rev. f pub. 5/15 en 20 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array sensor pixel array the active pixel array is 640 x 480 pixels. in addition, there are rows and columns for lens alignment and demosaic. not shown in figure 7 are pixels for black level calibration. figure 7: sensor pixel array the range of adjustment is from row 0 to 22 and column 0 to 30. there are 4 rows/ columns needed to calculate the rgb values. the window should be moved only at even numbers. figure 8: pixel color pattern detail (top right corner) lens alignment pixels - 16 columns lens alignment pixels - 12 rows lens alignment pixels - 12 rows lens alignment pixels - 16 columns demosaic pixels - 4 columns demosaic pixels - 4 columns demosaic pixels - 4 rows demosaic pixels - 4 rows active pixels 640 rows, 480 columns black pixels column readout direction . . . ... row readout direction r g r g b g first active border pixel (64, 0) r g r g b g r g r g b g g b g g r g b g b g r g b g b g r g b g b b g b
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array mt9v128_ds rev. f pub. 5/15 en 21 ?semiconductor components industries, llc,2015. output data format the sensor core image data are read out in progressive scan order. valid image data are surrounded by horizontal and vert ical blanking, shown in figure 9. for ntsc output, the horizontal size is stretc hed from 640 to 720 pixels. the vertical size is 243 pixels per field; 240 imag e pixels and 3 dark pixels that are located at the bottom of the image field. for pal output, the horizontal size is also st retched from 640 to 720 pixels. the vertical size is 288 pixels per field. figure 9: spatial illustration of image readout p 0,0 p 0,1 p 0,2 .....................................p 0,n-1 p 0,n p 2,0 p 2,1 p 2,2 .....................................p 2,n-1 p 2,n 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 p m-2,0 p m-2,1 .....................................p m-2,n-1 p m-2,n p m,0 p m,1 .....................................p m,n-1 p m,n 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 valid image odd field horizontal blanking vertical even blanking vertical/horizontal blanking p 1,0 p 1,1 p 1,2 .....................................p 1,n-1 p 1,n p 3,0 p 3,1 p 3,2 .....................................p 3,n-1 p 3,n 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 p m-1,0 p m-1,1 .....................................p m-1,n-1 p m-1,n p m+1,0 p m+1,1 ..................................p m+1,n-1 p m+1,n 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 valid image even field horizontal blanking vertical odd blanking vertical/horizontal blanking
mt9v128_ds rev. f pub. 5/15 en 22 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array image flow processor image and color processing in the mt9v 128 are implemented as an image flow processor (ifp) coded in hardware logic. during normal operation, the embedded microcontrolle r will automatically adjust the oper ation parameters. the ifp is broken down into different sections, as outlined in figure 10. figure 10: color pipeline test pattern generator black level subtraction color correction aperture correction gamma correction (12-to-8 lookup) statistics engine color kill output formatting yuv to rgb raw data 10/12-bit rgb raw 10 8-bit rgb 8-bit yuv parallel output output interface rgb to yuv digital gain control lens shading correction defect correction, noise reduction, color interpolation mux ifp parallel output mux pixel array adc analog output mux ntsc/pal
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array mt9v128_ds rev. f pub. 5/15 en 23 ?semiconductor components industries, llc,2015. test patterns during normal operation of the mt9v128, a stream of raw image data from the sensor core is continuously fed into the color pipeline. for test purposes, this stream can be replaced with a fixed image generated by a special test module in the pipeline. the module provides a selection of test patterns sufficient for basic testing of the pipeline. test patterns are accessible by programming a register and are shown in figure 11. on semiconductor recommends disabling the mcu before enabling test patterns. figure 11: color bar test pattern test pattern example flat field vertical ramp color bar vertical stripes pseudo-random
mt9v128_ds rev. f pub. 5/15 en 24 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array ntsc/pal test pattern generation there is a built-in standard eia (ntsc) and ebu (pal) color bars to support hue and color saturation characterization. each patt ern consists of seven color bars (white, yellow, cyan, green, magenta, red, and blue). the y, cb and cr values for each bar are detailed in tables 7 and 8. the test pattern is invoked through a host command call to the tx manager. see the mt9v128 host command specification. figure 12: color bars ccir-656 format the color bar data is encoded in 656 data streams. the duration of the blanking and active video periods of the generated 656 da ta are summarized in the following tables. table 4: eia color bars (ntsc) nominal range white yellow cyan green magenta red blue y 16 to 235 180 162 131 112 84 65 35 cb 16 to 240 128 44 156 72 184 100 212 cr 16 to 240 128 142 44 58 198 212 114 table 5: ebu color bars (pal) nominal range white yellow cyan green magenta red blue y 16 to 235 235 162 131 112 84 65 35 cb 16 to 240 128 44 156 72 184 100 212 cr 16 to 240 128 142 44 58 198 212 114 table 6: ntsc line numbers field description 1-3 2 blanking 4-19 1 blanking 20-263 1 active video 264-265 1 blanking 266-282 2 blanking 283-525 2 active video
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array mt9v128_ds rev. f pub. 5/15 en 25 ?semiconductor components industries, llc,2015. black level subtract ion and digital gain image stream processing starts with black level subtraction and multiplication of all pixel values by a programmable digital gain. both operations can be independently set to separate values for each color channel (r, gr, gb, b). independent color channel digital gain can be adjusted with registers. independent color channel black level adjust- ments can also be made. if the black level su btraction produces a negative result for a particular pixel, the value of this pixel is set to 0. positional gain adjustments (pga) lenses tend to produce images whose bright ness is significantly attenuated near the edges. there are also other factors causing fixed pattern signal gradients in images captured by image sensors. the cumulative result of all these factors is known as image shading. the mt9v128 has an embedded shading correction module that can be programmed to counter the shading effects on each individual r, gb, gr, and b color signal. the correction function the correction functions can then be appl ied to each pixel value to equalize the response across the image as follows: (eq 1) where p are the pixel values and f is the color dependent correction functions for each color channel. color interpolation in the raw data stream fed by the sensor core to the ifp, each pixel is represented by a 10-bit integer number, which can be considered proportional to the pixel's response to a one-color light stimulus, red, green, or blue , depending on the pixel's position under the color filter array. initial data processing step s, up to and including the defect correction, preserve the one-color-per-pixel nature of th e data stream, but after the defect correc- tion it must be converted to a three-colors -per-pixel stream appropriate for standard color processing. the conversion is done by an edge-sensitive color interpolation module. the module pads the incomplete color information available for each pixel with information extracted from an appropri ate set of neighboring pixels. the algorithm used to select this set and extract the in formation seeks the best compromise between preserving edges and filtering out high frequency noise in flat field areas. the edge threshold can be set th rough register settings. table 7: pal line numbers field description 1-22 1 blanking 23-310 1 active video 311-312 1 blanking 313-335 2 blanking 336-623 2 active video 624-625 2 blanking p corrected (row,col)=p sensor (row,col)*f(row,col)
mt9v128_ds rev. f pub. 5/15 en 26 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array color correction and aperture correction to achieve good color fidelity of the ifp outp ut, interpolated rgb values of all pixels are subjected to color correction. the ifp multiplies each vector of three pixel colors by a 3 x 3 color correction matrix. the three components of the resulting color vector are all sums of three 10-bit numbers. since such sums can have up to 12 significant bits, the bit width of the image data stream is widened to 12 bits per color (36 bits per pixel). the color correction matrix can be either programmed by the user or automatically selected by the auto white balance (awb) algorithm implemented in the ifp. color correction should ideally produce output colors that ar e corrected for the spectral sensitivity and color crosstalk characteristics of the imag e sensor. the optimal values of the color correction matrix elements depend on those sensor characteristics and on the spectrum of light incident on the sensor. the color co rrection variables can be adjusted through register settings. to increase image sharpness, a programmable 2d aperture correction (sharpening filter) is applied to color-corrected image data. the gain and threshold for 2d correction can be defined through register settings.
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array mt9v128_ds rev. f pub. 5/15 en 27 ?semiconductor components industries, llc,2015. gamma correction the mt9v128 ifp includes a block for gamma co rrection that can adjust its shape based on brightness to enhance the performanc e under certain lighting conditions. two custom gamma correction tables may be uploaded corresponding to a brighter lighting condition and a darker lighting condition. at power-up, the ifp loads the two tables with default values. the final gamma correction table used depends on the brightness of the scene and takes the form of an inte rpolated version of the two tables. the gamma correction curve (as shown in figure 13) is implemented as a piecewise linear function with 19 knee points, taking 12-bit arguments and mapping them to 8-bit output. the abscissas of the knee points are fixed at 0, 64, 128, 256, 512, 768, 1024, 1280, 1536, 1792, 2048, 2304, 2560, 2816, 3072, 3328, 3584, 3840, and 4096. the 8-bit ordinates are programmable through ifp registers. figure 13: gamma correction curve rgb to yuv conversion for further processing, the data is converted from rgb color space to yuv color space. color kill to remove high-or low-light color artifacts, a color kill circuit is included. it affects only pixels whose luminance exceeds a certain preprogrammed threshold. the u and v values of those pixels are attenuated proporti onally to the difference between their lumi- nance and the threshold. yuv color filter as an optional processing st ep, noise suppression by one-dimensional low-pass filtering of y and/or uv signals is possible. a 3- or 5-tap filter can be selected for each signal.
mt9v128_ds rev. f pub. 5/15 en 28 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array yuv-to-rgb/yuv conversion and output formatting the yuv data stream emerging from the scal ing module can either exit the color pipe- line as-is or be converted before exit to an alternative yuv or rgb data format. output format and timing yuv/rgb data ordering the mt9v128 supports swapping ycbcr mode, as illustrated in table 11. the rgb output data ordering in default mode is shown in table 12. the odd and even bytes are swapped when luma/chroma swap is enabled. r and b channels are bit-wise swapped when chroma swap is enabled. uncompressed 10-bit bypass output raw 10-bit bayer data from the sensor core ca n be output in bypass mode in two ways: ? using 8 data output signals (d out [7:0]) and gpio[1:0]. the gpio signals are the least significant 2 bits of data. ? using only 8 signals (d out [7:0]) and a special 8 + 2 data format, shown in table 13. readout formats progressive format is used for raw bayer output. table 8: ycbcr output data ordering mode data sequence default (no swap) cb i y i cr i y i+1 swapped cbcr cr i y i cb i y i+1 swapped yc y i cb i y i+1 cr i swapped cbcr, yc y i cr i y i+1 cb i table 9: rgb ordering in default mode mode (swap disabled) byte d 7 d 6 d 5 d 4 d 3 d 2 d 1 d 0 565rgb odd r 7 r 6 r 5 r 4 r 3 g 7 g 6 g 5 even g 4 g 3 g 2 b 7 b 6 b 5 b 4 b 3 555rgb odd 0 r 7 r 6 r 5 r 4 r 3 g 7 g 6 even g 5 g 4 g 3 b 7 b 6 b 5 b 4 b 3 444xrgb odd r 7 r 6 r 5 r 4 g 7 g 6 g 5 g 4 even b 7 b 6 b 5 b 4 0 0 0 0 x444rgb odd 0 0 0 0 r 7 r 6 r 5 r 4 even g 7 g 6 g 5 g 4 b 7 b 6 b 5 b 4 table 10: 2-byte bayer format byte bits used bit sequence odd bytes 8 data bits d 9 d 8 d 7 d 6 d 5 d 4 d 3 d 2 even bytes 2 data bits + 6 unused bits 0 0 0 0 0 0 d 1 d 0
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor sensor pixel array mt9v128_ds rev. f pub. 5/15 en 29 ?semiconductor components industries, llc,2015. output formats itu-r bt.656 and rgb output the mt9v128 can output proce ssed video as a standard itu-r bt.656 (ccir656) stream, an rgb stream, or as unprocessed bayer da ta. the itu-r bt.656 stream contains ycbcr 4:2:2 data with fixed embedded synchronization codes. this output is typically suitable for subsequent display by standard vi deo equipment or jpeg/mpeg compression. colorpipe data (pre-lens correction and overlay) can also be output in ycbcr 4:2:2 and a variety of rgb formats in 640 by 480 progressive format in conjunction with line_valid and frame_valid. the mt9v128 can be configured to output 16-bit rgb (565rgb), 15-bit rgb (555rgb), and two types of 12-bit rgb (444rgb). refer to table 31 and table 32 on page 57 for details. bayer output unprocessed bayer data are generated when bypassing the ifp completely?that is, by simply outputting the sensor bayer stream as usual, using frame_valid, line_valid, and pixclk to time the data. this mode is called sensor stand-alone mode. output ports composite video output the composite video output dac is external -resistor-programmable and supports both single-ended and diffe rential output. the dac is driven by the on-chip video encoder output. parallel output parallel output uses either 8-bit or 10-bit output. eight-bit output is used for itu-r bt.656 and rgb output. ten-bit output is used for raw bayer output.
mt9v128_ds rev. f pub. 5/15 en 30 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor usage modes usage modes how a camera based on the mt9v128 will be configured depends on what features are used. in the simplest case, only an mt9v128 plus an external flas h memory, or an 8-bit microcontroller (c) might be sufficient.a back-up camera with dynamic input from the steering system will require a c with a system bus interface such as a can bus or a lin bus. flash sizes vary depending on the data for registers, firmware, and overlay data? somewhere between 10kb to 16mb. the two-wire bus is adequate since only high-level commands are used to invoke overlays, load registers from memory, or set up lens correction parameters. overlay da ta can alternatively be issued by the external c if the rate of refreshing data is deemed adequate. if there are no commands in the flash image the device can be in auto configuration mode by which the sensor is set up according to the status of pins frame_ valid, line_valid and d out _lsb0. for further information, see ?auto-configuration? on page 26. in the simplest case no flash memory or c is required, as shown in figure 14. this is truly a single chip operation. note: because mandatory patches must be loaded, the auto-config mode is not recom- mended. figure 14: auto-config mode the mt9v128 can be configured by a serial flash through the spi interface. figure 15: flash mode analog out digital out auto-config mode mt9v128 mt9v128 spi serial flash
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor usage modes mt9v128_ds rev. f pub. 5/15 en 31 ?semiconductor components industries, llc,2015. overlay functions can also be assigned to general purpose inputs. for instance, a prox- imity sensor would call up a warning message . that capability can be employed on all configurations with external flash memory by mapping overlay images to an input. alternatively, the c may poll these inputs to create an action such as a new overlay as shown in figure 16. figure 16: usage mode 3 typically, an automotive bus such as can or lin bus will be connected to a rear-view camera for the purpose of dynamically providing steering information that will in turn be translated into overlay images being called by the c as shown in figure 17. figure 17: host mode with flash overlay information may also be passed by the c without a need for a flash memory. however, because the data transfer rate is limited over the two-wire serial bus, the update rate may be slower. however, if overlay images are preloaded into the four on- chip buffers, they may be turned on and off or move location at the frame rate as shown in figure 18. figure 18: host mode mt9v128 serial flash proximity sensor spi gpi[7:0] can/ lin bus mt9v128 spi 8/16bit c serial flash two-wire mt9v128 8/16bit c can / lin bus two-wire
mt9v128_ds rev. f pub. 5/15 en 32 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor external overlay external overlay in addition to the on-chip overlay generator, an externally generated overlay may be superimposed onto the video output. figure 19: external overlay system block diagram spi serial data flash 10kb to 16mb lp filter 27 mhz video_p cvbs pal/ntsc extclk video_n d out [7:0] pixclk overlay fpga/dsp d in clk d in [7:0]
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor multicamera support mt9v128_ds rev. f pub. 5/15 en 33 ?semiconductor components industries, llc,2015. multicamera support two or more mt9v128 sensors may be sync hronized to a frame by asserting the frame_sync signal. at that point, the se nsor and video encoder will reset without affecting any register settings. the mt9v128 may be triggered to be synchronized with another mt9v128 or an external event. figure 20: multicamera system block diagram camera 1 camera 2 cvbs cvbs can c mt9v128 mt9v128 f_ sync osc f_sync 1
mt9v128_ds rev. f pub. 5/15 en 34 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing external signal processing an external signal processor can take data from itu656 or raw bayer output format and post-process or compress the data in various formats. figure 21: external signal processing block diagram device configuration after power is applied and the device is out of reset by de-asserting the reset_bar pin, it will enter a boot sequence to configure its operating mode. there are essentially four modes, two when flash is present and two when flash is not present. figure 22: ?power- up sequence ? configuration options flow chart,? on page 27 contains more details on the configuration options. if flash is present and: ? a valid flash device identifier is detected and the flash device contains valid config- uration records, then ? disable auto-config ? parse flash content ? load flash configuration ->flash configuration mode ? a valid flash device identifier is detected but the flash device does not contain valid configuration records, then ? enter auto configuration. if flash is not present and: ? spi_sdi == 0, then ? enter host configuration. ? spi_sdi != 0, then ? enter auto configuration spi serial data flash 10kb to 16mb 27 mhz video_p cvbs pal/ntsc extclk video_n d out [7:0] pixclk signal processor
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing mt9v128_ds rev. f pub. 5/15 en 35 ?semiconductor components industries, llc,2015. auto-configuration the device supports an auto-configuration fe ature. during system start-up, the device first detects whether an spi flas h device is attached to the mt9v128. if not, it will then sample the state of a number of gpi inpu ts including frame_valid, line_valid and d out _lsb0. for more information, see table 16, ?gpio bit descriptions,? on page 28. the state of these inputs then determines th e configuration of a number of subsystems of the device such as readout mode, pe destal and video format, respectively. the auto-configuration feature can be disabled by grounding the spi_d in pin. the device samples the state of this pin during th e flash device detection process. if no spi flash device is detected (read device id of 0x00 or 0xff), or the spi_d in pin is grounded, then auto-confi guration is disabled. flash configuration mode if a valid flash is detected (by reading devi ce id other than 0x00 or 0xff) and the flash device contains valid configuration record s, then these configuration records are processed. host configuration this mode is entered if the spi_din pin is grounded. the soc performs no configura- tion, and remains idle waiting for configuration and instruction from the host.
mt9v128_ds rev. f pub. 5/15 en 36 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing power sequence in power-up, the core voltage (1.8v) must tr ail the io (2.8v) by a positive number. all 2.8v rails can be turned on at the same time or follow the power-up sequence in figure 52: ?power up sequence,? on page 63. in power down, the sequence is reversed. the core voltage (1.8v) must be turned off before any 2.8v. refer to figure 53: ?power down sequence,? on page 64 for details. figure 22: power-up sequence C configuration options flow chart supported spi devices table 14 lists supported flash devices. devices not compatible will require a firmware patch. contact on semiconductor for additional support. table 11: spi flash devices type density manufacturer device speed (mhz) standard temp range (f) supported flash 8 mb atmel at26df081a 70 jedec/device id C20 to +85 yes flash 1 mb st m25p10-avmb3 50 C40 to +125 yes power up /reset flash header? auto configuration : frame_valid, line_valid, d out _lsb0 spi _sdi = 0? wait for host command wait for host command disable auto -config parse flash content wait for host command yes no yes frame_valid line_valid d out _lsb0 0: normal 1: horizontal mirror 0 no pedestal 1: pedestal 0: ntsc 1: pal disable auto-config no flash configuration : host configuration : host configuration :
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing mt9v128_ds rev. f pub. 5/15 en 37 ?semiconductor components industries, llc,2015. supported spi commands the spi commands shown in table 15 are supported by the mt9v128. table 12: spi commands supported command value read array 0x03 block erase 0xd8 chip erase 0xc7 read status 0x05 write status 0x01 byte page program 0x02 write enable 0x06 write disable 0x04 read manufacturer and device id 0x9f (fast) read array 0x0b table 13: gpio bit descriptions gpi[2] (dout_lsb0) gpi[1] (frame_valid) gpi[0] (line_valid) low (0) ntsc normal no pedestal high (1) pal horizontal mirror pedestal
mt9v128_ds rev. f pub. 5/15 en 38 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing host command interface on semiconductor?s sensors and socs contain numerous registers that are accessed through a two-wire interface with speeds up to 400 khz. the mt9v128, in addition to writing or read ing straight to/from registers or firmware variables, has a mechanism to write higher level commands, the host command inter- face (hci). once a command has been written th rough the hci, it will be executed by on chip firmware and the results are reported back. in general, registers shall not be accessed with the exception of registers that are marked for ?user access.? flash memory is also available to store commands for later execution. under dma control, a command is written into the soc and executed. for a complete spec on host commands, refer to the mt9v128 host command interface specification. figure 23: interface structure host command to fw response from fw 15 0 bit 1 0 `` command register addr 0x40 addr 0xfc00 ` ` ` ` ` ` ` ` addr 0xfc0e addr 0xfc02 addr 0xfc04 addr 0xfc06 addr 0xfc08 addr 0xfc0a addr 0xfc0c 14 door bell 15 0 bit parameter 0 parameter 7 cmd_handler_params_pool_0 cmd_handler_params_pool_1 cmd_handler_params_pool_2 cmd_handler_params_pool_3 cmd_handler_params_pool_4 cmd_handler_params_pool_5 cmd_handler_params_pool_6 cmd_handler_params_pool_7
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing mt9v128_ds rev. f pub. 5/15 en 39 ?semiconductor components industries, llc,2015. host command process flow command flow the host issues a command by writing (through a two-wire interface bus) to the command register. all commands are encode d with bit 15 set, which automatically generates the host command (doorbell ) interrupt to the microprocessor. assuming initial conditions, the host first wr ites the command parameters (if any) to the parameters pool (in the command handler's lo gical page), then writes the command to command register. the interrupt handler th en signals the command handler task to process the command. if the host wishes to determine the outcome of the command, it must poll the command register waiting for the doorbell bit to be cleared. this indicates that the firmware completed processing the command. the contents of the command register indicate the command's result status. if the command gen erated response parameters, the host can now retrieve these from the parameters pool. re ad co mmand r e g iste r doo r b e ll bit cle ar ? no co mmand h a s p a ra m ete r s ? ye s w r it e param ete r s to p aram ete r po o l ye s w r it e co mmand to co mmand r e g ist e r no iss u e co mmand ho st co u l d i n se r t an o p tio na l d el a y he r e host co u l d i n se r t an o p tio na l d el a y he r e w a it f o r a r es p o n se? re ad co mma n d r e g ist e r doo r bell bit cle ar ? ye s no co mmand h a s r es p o n se param ete r s ? ye s re ad r es p o n se param ete r s f r o m p aram ete r po o l ye s at th is p oi n t co mmand re g ist e r co n t a i n s r es p o n se co d e do n e no no no
mt9v128_ds rev. f pub. 5/15 en 40 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing note: the host must not write to the parameters pool, nor issue another command, until the previous command completes. this is true even if the host does not care about the result of the previous command. therefore, the host must always poll the command register to determine the state of the doorbell bit, and ensure the bit is cleared before issuing a command. for a complete command list and further in formation consult the host command inter- face specification. an example of how (using devware) a command may be initiated in the form of a ?preset? follows. set parallel mode - normal (overlay i656) all devware presets supplied by on semiconductor poll and test the doorbell bit after issuing the command. therefore there is no need to check if the doorbell bit is clear before issuing the next command. reg= 0xfc00, 0x1000 // cmd_handler_params_pool_0 reg= 0x0040, 0x8801 // issue command // poll command_register::doorbell => 0x0 summary of host commands table 17 on page 31 through table 23 on page 34 show summaries of the host commands. the commands are divided into the following sections: ? system manager ?overlay ? dewarp (or lens distortion correction) ?gpio host interface ? flash manager host ? patch loader interface ? tx manager following is a summary of the host interface commands. the description gives a quick orientation. the ?type? column shows if it is an asynchronous or synchronous command. for a complete list of all comman ds including parameters, consult the host command interface specification document. table 14: system manager commands system manager host command value type description set state 0x8100 asynchronous request the system enter a new state get state 0x8101 synchronous get the current state of the system table 15: overlay host commands overlay host command value type description enable overlay 0x8200 synchronous enable or disable the overlay subsystem get overlay state 0x8201 synchronous retrieve the state of the overlay subsystem set calibration 0x8202 synchronous set the calibration offset set bitmap property 0x8203 synchronous set a property of a bitmap get bitmap property 0x8204 synchronous get a property of a bitmap
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing mt9v128_ds rev. f pub. 5/15 en 41 ?semiconductor components industries, llc,2015. set string property 0x8205 synchronous set a property of a character string load buffer 0x8206 asynchronous load an overlay buffer with a bitmap (from flash) load status 0x8207 synchronous retrieve status of an active load buffer operation write buffer 0x8208 synchronous write directly to an overlay buffer read buffer 0x8209 synchronous read directly from an overlay buffer enable layer 0x820a synchronous enable or disable an overlay layer get layer status 0x820b synchronous retrieve the status of an overlay layer set string 0x820c synchronous set the character string load string 0x820e asynchronous load a character string (from flash) table 16: dewarp commands dewarp host command value type description enable dewarp 0x8300 asynchronous enabl e or disable the dewarp subsystem get dewarp state 0x8301 synchronous retrieve the current state of the dewarp subsystem load config 0x8302 asynchronous load a pair of dewarp configuration sets fr om spi flash into local cache (and apply) config status 0x8303 synchronous retrieve th e status of a load config request write config 0x8304 synchronous write a dewarp config uration set under host control into local cache apply config 0x8305 asynchronous apply a dewarp configuration set stored in local cache read config 0x8306 synchronous read a dewarp configuration set under host control. table 17: gpio host commands gpio host command value type description set gpio property 0x8400 synchronous set a property of one or more gpio pins get gpio property 0x8401 synchronous retrieve a property of a gpio pin set gpo state 0x8402 synchronous set the state of a gpo pin or pins get gpio state 0x8403 synchronous ge t the state of a gpi pin or pins set gpi association 0x8404 synchronous associate a gpi pin state with a command sequence stored in spi flash table 18: flash manager host commands flash manager host command value type description get lock 0x8500 asynchronous request the flash manager access lock lock status 0x8501 synchronous retrieve th e status of the access lock request release lock 0x8502 synchronous release the flash manager access lock config 0x8503 synchronous configure the flash manager and underlying spi flash subsystem read 0x8504 asynchronous read data from the spi flash write 0x8505 asynchronous write data to the spi flash erase block 0x8506 asynchronous erase a block of data from the spi flash erase device 0x8507 asynchrono us erase the spi flash device table 15: overlay host commands overlay host command value type description
mt9v128_ds rev. f pub. 5/15 en 42 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing query device 0x8508 asynchronous query device-specific information status 0x8509 synchronous obtain status of current asynchronous operation table 19: sequencer host commands sequencer host command value type description set encoding mode 0x8603 synchronous set the encoding mode enable horizontal flip 0x8604 synchronous enable or disable horizontal flip set flicker frequency 0x8605 synchronous set the flicker frequency refresh mode 0x8606 synchronous refr esh the sequencer mode/context table 18: flash manager host commands flash manager host command value type description
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor external signal processing mt9v128_ds rev. f pub. 5/15 en 43 ?semiconductor components industries, llc,2015. table 20: tx manager host commands tx manager host command value type description config dac 0x8800 synchronous configure the video dac set parallel mode 0x8801 synchronous configure the parallel output port
mt9v128_ds rev. f pub. 5/15 en 44 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor slave two-wire serial interface slave two-wire serial interface the two-wire serial interface bus enables read /write access to control and status regis- ters within the mt9v128. this interface is desi gned to be compatible with the mipi alli- ance standard for camera serial interfac e 2 (csi-2) 1.0, which uses the electrical characteristics and transfer protocols of th e two-wire serial interface specification. the interface protocol uses a master/slave model in which a master controls one or more slave devices. the sensor acts as a slave device. the master generates a clock (sclk) that is an input to the sens or and used to synchronize transfers. data is transferred between the master an d the slave on a bidirectional signal (s data ). s data is pulled up to v dd _io off-chip by a pull-up resistor in the range of 1.5 to 4.7k ? resistor. protocol data transfers on the two-wire serial interf ace bus are performed by a sequence of low- level protocol elements, as follows: ? a start or restart condition ? a slave address/data direction byte ? a 16-bit register address ? an acknowledge or a no-acknowledge bit ?data bytes ? a stop condition the bus is idle when both sclk and s data are high. control of the bus is initiated with a start condition, and the bus is released with a stop condition. only the master can gen- erate the start and stop conditions. the s addr pin is used to select between two different addresses in case of conflict with another device. if s addr is low, the slave address is 0x90; if s addr is high, the slave address is 0xba. see table 24 below. start condition a start condition is defined as a high-to-low transition on s data while sclk is high. at the end of a transfer, the master can generate a start condition without previously generating a stop cond ition; this is known as a ?repeated start? or ?restart? condition. data transfer data is transferred serially, 8 bits at a time, with the msb transmitted first. each byte of data is followed by an acknowledge bit or a no-acknowledge bit. this data transfer mechanism is used for the slave address/da ta direction byte and for message bytes. one data bit is transferred during each sclk clock period. s data can change when sclk is low and must be stable while sclk is high. table 21: two-wire interface id address switching s addr two-wire interface address id 00x90 10xba
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor slave two-wire serial interface mt9v128_ds rev. f pub. 5/15 en 45 ?semiconductor components industries, llc,2015. slave address/data direction byte bits [7:1] of this byte represent the device slave address and bit [0] indicates the data transfer direction. a ?0? in bit [0] indicates a write, and a ?1? indicates a read. the default slave addresses used by the mt9v128 are 0x90 (write address) and 0x91 (read address). alternate slave addresses of 0xba (write address) and 0xbb (read address) can be selected by asserting the s addr input signal. message byte message bytes are used for sending register addresses and register write data to the slave device and for retrieving register read data. the protocol used is outside the scope of the two-wire serial interface specification. acknowledge bit each 8-bit data transfer is followed by an acknowledge bit or a no-acknowledge bit in the sclk clock period following the data transfer . the transmitter (which is the master when writing, or the slave when reading) releases s data . the receiver indicates an acknowl- edge bit by driving s data low. as for data transfers, s data can change when sclk is low and must be stable while sclk is high. no-acknowledge bit the no-acknowledge bit is generated when the receiver does not drive s data low during the sclk clock period following a data transf er. a no-acknowledge bit is used to termi- nate a read sequence. stop condition a stop condition is defined as a low-to-high transition on s data while sclk is high.
mt9v128_ds rev. f pub. 5/15 en 46 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor slave two-wire serial interface typical operation a typical read or write sequence begins by the master generating a start condition on the bus. after the start condition, the master sends the 8-bit slave address/data direction byte. the last bit indicates whether the requ est is for a read or a write, where a ?0? indicates a write and a ?1? indicates a read. if the address matches the address of the slave device, the slave device acknowledges receipt of the address by generating an acknowledge bit on the bus. if the request was a write, the master then tr ansfers the 16-bit register address to which a write will take place. this transfer take s place as two 8-bit sequences and the slave sends an acknowledge bit after each sequen ce to indicate that the byte has been received. the master will then transfer the 16-bit data, as two 8-bit sequences and the slave sends an acknowledge bit after each sequ ence to indicate that the byte has been received. the master stops writing by generat ing a (re)start or stop condition. if the request was a read, the master sends the 8-bi t write slave address/data direction byte and 16-bit register address, just as in the write request. the master then generates a (re)start condition and the 8-bit read slave address/data direction byte, and clocks out the register data, 8 bits at a time. the mast er generates an acknowledge bit after each 8- bit transfer. the data transfer is stopped when the master sends a no-acknowledge bit. single read from random location figure 24 shows the typical read cycle of th e host to mt9v128. the first two bytes sent by the host are an internal 16-bit register address. the following 2-byte read cycle sends the contents of the registers to host. figure 24: single read from random location single read from current location figure 25 shows the single read cycle without writing the address. the internal address will use the previous address value written to the register. figure 25: single read from current location s = start condition p = stop condition sr = restart condition a = acknowledge a = no-acknowledge slave to master master to slave slave address 0 s a reg address[15:8] a reg address[7:0] slave address a a 1 sr read data [15:8] p previous reg address, n reg address, m m+1 a read data [7:0] a slave address 1 s a read data [15:8] slave address a 1 s p read data [15:8] p previous reg address, n reg address, n+1 n+2 a a read data [7:0] a read data [7:0] a
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor slave two-wire serial interface mt9v128_ds rev. f pub. 5/15 en 47 ?semiconductor components industries, llc,2015. sequential read, start from random location this sequence (figure 26) starts in the same way as the single read from random loca- tion (figure 24 on page 37). instead of gener ating a no-acknowledge bit after the first byte of data has been transferred, the master generates an acknowledge bit and continues to perform byte reads until ?l? bytes have been read. figure 26: sequential read, start from random location sequential read, start from current location this sequence (figure 27) starts in the same way as the single read from current loca- tion (figure 25). instead of generating a no-a cknowledge bit after the first byte of data has been transferred, the master genera tes an acknowledge bit and continues to perform byte reads until ?l? bytes have been read. figure 27: sequential read, start from current location single write to random location figure 28 shows the typical write cycle from the host to the mt9v128. the first 2 bytes indicate a 16-bit address of the internal registers with most-significant byte first. the following 2 bytes indicate the 16-bit data. figure 28: single write to random location read data (15:8) a a read data (15:8) a read data (7:0) a slave address 0 s sr a reg address[15:8] a reg address[7:0] a read data slave address previous reg address, n reg address, m m+1 m+2 m+1 m+3 a 1 m+l-2 m+l-1 m+l a p a read data (15:8) a read data (7:0) a read data (15:8) a read data (7:0) a read data (7:0) a read data read data previous reg addr ess, n n+1 n+2 n+l-1 n+l a read data slave address a a 1 a s p read data (15:8) a read data (7:0) a read data (15:8) a read data (7:0) a read data (15:8) a read data (7:0) a read data read data (15:8) a read data (7:0) slave address 0 s a reg add ress[15:8] a reg add ress[7:0] a p previous reg address, n reg addr ess, m m+1 a a wri te data
mt9v128_ds rev. f pub. 5/15 en 48 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor slave two-wire serial interface sequential write, start at random location this sequence (figure 29) starts in the same way as the single write to random location (figure 28). instead of generating a no-acknowledge bit after the first byte of data has been transferred, the master generates an acknowledge bit and continues to perform byte writes until ?l? bytes have been writte n. the write is terminated by the master generating a st op condition. figure 29: sequential write, start at random location slave address 0 s a reg address[15:8] write data a reg address[7:0] a write data previous reg address, n reg address, m m+1 m+2 m+1 m+3 a aa write data write data m+l-2 m+l-1 m+l a a p write data (15:8) write data (7:0) write data (15:8) a write data (7:0) a a a a write data a write data (15:8) a write data (7:0) a write data write data (15:8) a write data (7:0)
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor integrated lens distortion correction mt9v128_ds rev. f pub. 5/15 en 49 ?semiconductor components industries, llc,2015. integrated lens distortion correction integrated lens distortion correction elimin ates the need for an expensive dsp for image correction. using software tools, a flexible algorithm can be calibrated for many wide-angle lenses. lens distortion definition automotive backup cameras typically feature a wide fov lens so that a single camera mounted above the center of the rear bumper can present the driver with a view of all potential obstacles immediately behind the full width of the vehicle. lenses with a wide field of view typically exhi bit at least a noticeable am ount of barrel distortion. barrel distortion is caused by a reduction in object magnification the further away from the optical axis. a barrel distortion percenta ge can be measured as the amount a refer- ence line is bent as a percentage of the image height. for example, the lens used to capture the image below demonstrates a barrel distortion of approximately 21 percent. the distortion of this lens is near the maximum amount of distortion that must be corrected by themt9v128. figure 30: barrel distortion definition for the image to appear natural to the driver, themt9v128 corrects this barrel distortion and reprocesses the image so that the result ing distortion is less than one percent. table 22: lens correction features description value references/comments hfov 60 to180 hfov (horizontal field of view) aperture range f#2.0 to f#4.0 aperture range maximum lens distortion 25% maximum lens distortion as percentage of fov maximum distortion after correction 1% maximum distortion after correction input resolution 640 x 480 progressive scan output resolution 720 x 240 ntsc mode 720 x 288 pal mode horizontal 10% vertical +10% to C25% distortion = 100 rows image height = 480 rows barrel distortion of 21% (100/480)
mt9v128_ds rev. f pub. 5/15 en 50 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor integrated lens distortion correction lens distortion correction distortion correction is the ability to digita lly correct the lens barrel distortion and to provide a natural view of objects. in addition, with barrel dist ortion one can adjust the perspective view to enhance the visibility by virtually elevating the point of viewing objects. notes: 1. this image shows the original image with the ta rgeted field of view (fov ), which is programmable, after correction. 2. the image is corrected. 3. the image is cropped to its largest usable rectangle. 4. the image is finally cropped and sc aled up to ntsc output format. 1 3 4 2 1 2 3 4
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor integrated lens distortion correction mt9v128_ds rev. f pub. 5/15 en 51 ?semiconductor components industries, llc,2015. perspective view a backup camera has to be able to virtuall y adjust the vertical perspective as if the camera were placed immediately behind the vehicle pointed directly down, as illus- trated in figure 31. the vertical perspective adjustment may be employed temporarily to assist with parking conditions, or it may be enabled permanently by loading new param- eters. figure 31: vertical perspective adjustment in the transition between diffe rent settings, one or two black frames may be inserted temporarily, resulting in a slight flicker. conversion sequence starting with the captured distorted image, the conversion process sequence is shown in figure 32 on page 43. the configuration data cr eated by the lens distortion emulator are then transferred into the memory compile tool with devware. perspective adjustment an g le
mt9v128_ds rev. f pub. 5/15 en 52 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor integrated lens distortion correction figure 32: conversion sequence notes: 1. a distorted ntsc output image may be taken by the mt9v128. 2. distortion-corrected image created with on semiconductors lens distortion emulator program. 3. perspective view adjustment also using on semiconductors lens distortion emulator program. 3 1 2
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor overlay capability mt9v128_ds rev. f pub. 5/15 en 53 ?semiconductor components industries, llc,2015. overlay capability figure 33 highlights the graphical overlay data flow of the mt9v128. the images are separated to fit into 2kb blocks of memory after compression. ? up to four overlays may be blended simultaneously ? overlay size 360 x 480 pixels rendered into a display area of 720 x 480 pixels ? selectable readout: rotating order is user programmable ? dynamic movement through predefined overlay images ? palette of 32 colors out of 6 4,000 with eight colors per bitmap ? blend factors may be changed dynami cally to achieve smooth transitions the host commands allow a bitmap to be written piecemeal to a memory buffer through the i 2 c, and through the dma direct from spi flash memory. multiple encoding passes may be required to fit an image into a 2kb block of memory; alternatively, the image can be divided into two or more blocks to make the image fit. every graphic image may be positioned in an x/y direction and overlap with other graphic images. the host may load an image at any time. un der control of dma assist, data are trans- ferred to the off-screen buffer in compressed form. this assures that no display data are corrupted during the replenishment of the four active overlay buffers. figure 33: overlay data flow note: these images are not actually rendered, but show conceptual objects and object blending. off-screen buffer overlay buffers: 2kb each decompress blend and overlay flash bitmaps - compressed
mt9v128_ds rev. f pub. 5/15 en 54 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor serial memory partition serial memory partition the contents of the flash/eeprom memory pa rtition logically into three blocks (see figure 34): ? memory for overlay data and descriptors ? memory for register settings, wh ich may be loaded at boot-up ? firmware extensions or software patches; in addition to the on-chip firmware, exten- sions reside in this block of memory these blocks are not necessarily contiguous. figure 34: memory partitioning for a complete description of memory organization, refer to the mt9v128 spi flash contents encoding specification. external memory speed requirement for a 2kb block of overlay to be transferred within a frame time to achieve maximum update rate, the serial memory has to be a certain speed. table 23: transfer time estimate frame time spi clock transfer time to 2kb 33.3ms 4.5 mhz 1ms s/w patch alternate reg. setting overlay data flash partitioning fixed size overla y s-rle 12byte header rle encoded data 2kbyte fixed size overla y s-rle lens correction parameter fixed-size overlays ? rle fixed-size overlays ? rle flash partitioning overlay data software patch 12-byte header rle encoded data 2kb lens shading correction parameter alternate register setting
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor overlay adjustment mt9v128_ds rev. f pub. 5/15 en 55 ?semiconductor components industries, llc,2015. overlay adjustment to ensure a correct position of the overlay to compensate for assembly deviation, the overlay can be adjusted with assistance from the overlay statistics engine: ? the overlay statistics engine supports a windowed 8-bin luma histogram, either row- wise (vertical) or column-wise (horizontal). ? the example calibration statistics firmware patch can be used to perform an auto- matic successive-approximation search of a cross-hair target within the scene. ? on the first frame, the firmware performs a coarse horizontal search, followed by a coarse vertical search in the second frame. ? in subsequent frames, the firmware reduces th e region-of-interest of the search to the histogram bins containing the greatest accumulator values, thereby refining the search. ? the resultant x, y location of the cross-hair target can be used to assign a calibration value of offset selected overlay graphic image positions within the output image. ? the calibration statistics patch also suppo rts a manual mode, which allows the host to access the raw accumulator values directly. note: for the overlay calibration feature to work, load the appropriate patch. see statistics engine document.
mt9v128_ds rev. f pub. 5/15 en 56 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor overlay adjustment figure 35: overlay calibration the position of the target will be used to determine the calibration value that shifts the x,y position of adjustable overlay graphics. unlike the lens distortion correction and pe rspective correction, the overlay calibration is intended to be applied on a device by device basis ?in system,? which means after the camera has been installed. on semiconductor provides basic programming scripts that may reside in the spi flash memory to assist in this effort.
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor overlay character generator mt9v128_ds rev. f pub. 5/15 en 57 ?semiconductor components industries, llc,2015. overlay character generator in addition to the four overlay layers, a fift h layer exists for a character generator overlay string. there are a total of: ? 16 alphanumeric characters available ? 22 characters maximum per line ? 16 x 32 pixels with 1-bit color depth any update to the character generator string requires the string to be passed in its entirety with the host command. character strings have their own control properties aside from the overlay bitmap properties. figure 36: internal block diagram overlay overlay layer0 layer1 layer2 layer3 bt656 number generator bt656 timing control user registers data bus dma/cpu register bus rom
mt9v128_ds rev. f pub. 5/15 en 58 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor overlay character generator character generator the character generator can be seen as the fifth top layer, but instead of getting the source from rle data in the memory buffers, it has a predefined 16 characters stored in rom. all the characters are 1-bit depth color and are sharing the same ycbcr look up table. figure 37: example of character descriptor 0 stored in rom it can show a row of up to 22 characters of 16 x 32 pixels resolution (32 x 32 pixels when blended with the bt 656 data). rom 151413121110 9 8 7 6 5 4 3 2 1 0 0x00 0000000000000000 0x02 0000000000000000 0x04 0000001111000000 0x06 0000011111100000 0x08 0000111111110000 0x0a 0001111001111000 0x0c 0001110000111100 0x0e 0011110000011100 0x10 0011100000011100 0x12 0011100000011110 0x14 0111100000001110 0x16 0111000000001110 0x18 0111000000001110 0x1a 0111000000001110 0x1c 0111000000001110 0x1e 0111000000001110 0x20 0111000000001110 0x22 0111000000001110 0x24 0111000000001110 0x26 0111000000001110 0x28 0011100000001110 0x2a 0011100000011110 0x2c 0011100000011100 0x2e 0011110000011100 0x30 0001110000111000 0x32 0001111001111000 0x34 0000111111110000 0x36 0000011111100000 0x38 0000001111000000 0x3a 0000000000000000 0x3c 0000000000000000 0x3e 0000000000000000 ?
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor overlay character generator mt9v128_ds rev. f pub. 5/15 en 59 ?semiconductor components industries, llc,2015. character generator details table 27 shows the characters that can be generated. it is the responsibility of the user to set up proper values in the character positioning to fit them in the same row (that is one of the reasons that 22 is the maximum number of characters). note: no error is generated if the character row overruns the horizontal or vertical limits of the frame. full character set for overlay figure 38 shows all of the characters that can be generated by the mt9v128. figure 38: full character set for overlay table 24: character generator details item quantity description 16-bit character 22 coder for one of these characters: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, /, (space), :, C, (comma), (period) 1 bpp color 1 depth of the bit map is 1 bpp 0x0 0x4 0x 8 0xc 0x 1 0x5 0x9 0x2 0x3 0x6 0x7 0xa 0x b 0xd 0xe 0xf
mt9v128_ds rev. f pub. 5/15 en 60 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing modes and timing this section provides an overview of the typical usage modes and related timing infor- mation for the mt9v128. composite video output the external pin d out _lsb0 can be used to configure the device for default ntsc or pal operation. this and other vide o configuration settings are av ailable as register settings accessible through the serial interface. ntsc both differential and single-e nded connections of the full ntsc format are supported. the differential connection that uses two output lines is used for low noise or long distance applications. the single-ended connection is used for pcb tracks and screened cable where noise is not a concern. the ntsc format has three black lines at the bottom of each image for padding (which most lcds do not display). pal the pal format is supported with 576 active image rows. ntsc or pal with external image processing the on-chip video encoder and dac can be used with external data stream input (d in [7:0] port). correct ntsc or pal format ted ccir656 data is required for correct composite video output. the on-chip overlay may be put on top of th e overlay generated by the external overlay generator. single-ended and differential composite output the composite output can be operated in a si ngle-ended or differential mode by simply changing the external resistor configurat ion. for single-ended termination, see figure 39 on page 51. the differential sc hematic is shown in figure 40 on page 52. figure 39: single-ended termination v dd 75 75 chip boundary i = iplus i = iminus single-ended r1=75 single-ended e.g. pcb track e.g. 75 coax single-ended l = 1uh l = 1uh c = 330 c0 c1 c = 330 l0 l1 l2 typical values for lc 75 terminated receiver l = 2.2 h pf pf 75
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 61 ?semiconductor components industries, llc,2015. figure 40: differential co nnectiongrounded termination parallel output (d out ) the d out [7:0] port supports both progressive and interlaced mode. progressive mode (with fv and lv signal) include raw bayer(8 or 10 bit), ycbcr, rgb. interlaced mode is ccir656 compliant. figure 41 shows the data that is output on the parallel port for ccir656. both ntsc and pal formats are displayed. the blue values in figure 41 represent ntsc (525/60). the red values represent pal (625/50). figure 41: ccir656 8-bit parallel interface format for 525/60 (625/50) video systems figure 42 on page 53 shows detailed vertical blanking information for ntsc timing. see table 28 on page 53 for data on field, ve rtical blanking, eav, and sav states. f f 0 0 0 0 x y 8 0 1 0 8 0 1 0 8 0 1 0 f f 0 0 0 0 x y c b y c r y c b y c r y c r y f f 4 4 268 280 4 4 1440 1440 1716 1728 eav code blanking sav code co - sited _ co - sited _ start of digital line start of digital active line next line digital video stream
mt9v128_ds rev. f pub. 5/15 en 62 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing figure 42: typical ccir656 vertical bl anking intervals for 525/60 video system figure 43 shows detailed vertical blanking information for pal timing. see table 29 on page 54 for data on field, vertic al blanking, eav, and sav states. table 25: field, vertical blanking, eav, and sav states 525/60 video system line number f v h (eav) h (sav) 1C3 1 1 1 0 4C9 0 1 1 0 20C263 0 0 1 0 264C265 0 1 1 0 266C282 1 1 1 0 283C525 1 0 1 0 b l an ki ng fiel d 1 active vi d eo b l an ki ng fiel d 2 active vi d eo li n e 4 266 fiel d 1 (f = 0) o dd fiel d 2 (f = 1 ) eve n eav sav li n e 1 (v = 1 ) li n e 20 (v = 0) li n e 26 4 (v = 1 ) li n e 2 83 (v = 0) li n e 525 (v = 0) h = 1 h = 0
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 63 ?semiconductor components industries, llc,2015. figure 43: typical ccir656 vertical bl anking intervals for 625/50 video system table 26: field, vertical blanking, eav, and sav states for 625/50 video system line number f v h (eav) h (sav) 1C22 0110 23C310 0010 311C312 0110 313C335 1110 336C623 1010 624C625 1110 b l an ki ng fiel d 1 active vi d eo b l an ki ng fiel d 2 active vi d eo fiel d 1 (f = 0) o dd fiel d 2 (f = 1 ) eve n h = 1 eav h = 0 sav b l an ki ng li n e 1 (v = 1 ) li n e 2 3 (v = 0) li n e 311 (v = 1 ) li n e 33 6 (v = 0) li n e 625 (v = 1 ) li n e 62 4 (v = 1 )
mt9v128_ds rev. f pub. 5/15 en 64 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing parallel input (d in ) the data-in port allows external ccir656 data to be multiplexed into the ntsc or pal output data. figure 44 shows the timing of the data-in (d in [7:0]) signals. table 30 describes timing values for the parallel input waveform. both mode 0 and mode 1 wave- forms are supported. figure 44: parallel input data timing waveform using d in _clk note: setup and hold times are measured with respect to the rising or falling edge of d in _clk, which can be programmed by r0x0016[13]. table 27: parallel input data timing values using d in _clk name conditions min typical max parameter t d in _clk max 100 ppm C 37 C d in _clk period t s 8 C 18.5 d in setup time t h 8 C 18.5 d in hold time t din _ clk t s t h d0 d 1 d2 d 3 d 4 d5 d in [7:0] mode 0 t din _ clk t s t h d0 d 1 d2 d 3 d 4 d5 din _ clk mode 1 din _ clk d in [7:0]
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 65 ?semiconductor components industries, llc,2015. reset and clocks reset power-up reset is asserted or de-asserted with the reset_bar pin, which is active low. in the reset state, all control registers are set to default values. see ?device configura- tion? on page 25 for more details on auto, host, and flash configurations. soft reset is asserted or de-asserted by the two-wire serial interf ace program. in soft- reset mode, the two-wire serial interface and the register bus are still running. all control registers are reset using default values. clocks the mt9v128 has three primary clocks: ? a master clock coming from the extclk signal. ? in default mode, a pixel clock (pixclk) ru nning at 2 * extclk. in raw bayer bypass mode, pixclk runs at the same frequency as extclk. ?d in _clk that is associated with the parallel d in port. when the mt9v128 operates in sensor st and-alone mode, the image flow pipeline clocks can be shut off to conserve power. the sensor core is a master in the system. the sensor core frame rate defines the overall image flow pipeline frame rate. horizontal bl anking and vertical blanking are influenced by the sensor configuration, and are also a fu nction of certain imag e flow pipeline func- tions. the relationship of the primar y clocks is depicted in figure 45. the image flow pipeline typically generates up to 16 bits per pixel?for example, ycbcr or 565rgb?but has only an 8-bit port through which to communicate this pixel data. to generate ntsc or pal format images, the sensor core requires a 27 mhz clock. figure 45: primary clock relationships 10 bits/pixel 1 pixel/clock 16 bits/pixel 1 pixel/clock 16 bits/pixel (typ) 0.5 pixel/clock colorpipe output interface sensor pixel clock sensor master clock extclk sensor core d in _clk
mt9v128_ds rev. f pub. 5/15 en 66 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing floating inputs the following mt9v128 pins cannot be floated: ?d in _clk (tie to gnd if not used) ?s data ?this pin is bidirectional and should not be floated ? frame_sync ?trst_n output data ordering note: pixclk is 54 mhz wh en extclk is 27 mhz. note: pixclk is 27 mhz wh en extclk is 27 mhz. table 28: output data ordering in d out rgb mode mode (swap disabled) byte d7 d6 d5 d4 d3 d2 d1 d0 565rgb first r7r6r5r4r3g7g6g5 second g4 g3 g2 b7 b6 b5 b4 b3 555rgb first 0 r7 r6 r5 r4 r3 g7 g6 second g5 g4 g3 b7 b6 b5 b4 b3 444xrgb first r7r6r5r4g7g6g5g4 second b7 b6 b5 b4 0 0 0 0 x444rgb first 0000r7r6r5r4 second g7 g6 g5 g4 b7 b6 b5 b4 table 29: output data ordering in sensor stand-alone mode mode d7 d6 d5 d4 d3 d2 d1 d0 d out _lsb1 d out _lsb0 10-bit output b9 b8 b7 b6 b5 b4 b3 b2 b1 b0
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 67 ?semiconductor components industries, llc,2015. i/o circuitry figure 46 illustrates typical circuitry used for each input, output, or i/o pad. figure 46: typical i/o equivalent circuits note: all i/o circuitry shown above is for reference only. the actual implementation may be different. v dd _io receiver input pad pad gnd v dd _io receiver spi_sdi and reset_bar input pad pad gnd receiver gnd v dd _io pad i/o pad slew rate control v dd _io receiver sclk and xtal_in input pad pad gnd gnd xtal output pad pad v dd _io
mt9v128_ds rev. f pub. 5/15 en 68 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing figure 47: ntsc block note: all i/o circuitry shown above is for reference only. the actual implementation may be different. figure 48: serial interface pad v dd_ dac gnd pad pad esd esd dac_ref esd dac_pos dac_neg ntsc block resistor 4.7k /2.35k
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 69 ?semiconductor components industries, llc,2015. i/o timing digital output by default, the mt9v128 launches pixel data, fv, and lv synchronously with the falling edge of pixclk. the expectation is that the user captures data, fv, and lv using the rising edge of pixclk. the timing diagram is shown in figure 49. as an option, the polarity of the pixclk ca n be inverted from the default by program- ming r0x0016[14]. figure 49: digital output i/o timing note: pixclk can be inverted from the default by programming r0x0016[14]. table 30: parallel digital output i/o timing f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa = 2.8v; v aa _pix = 2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v; default slew rate signal parameter conditions min typ max unit extclk f extclk max 100 ppm C 27 C mhz t extclk_period C 37 C ns duty cycle 45 50 55 % pixclk 1 f pixclk C27Cmhz t pixclk_period C 37 C ns duty cycle 45 50 55 % data[7:0] t pixclkf_dout C2 0 2 ns t dout_su 8 C 18.5 ns t dout_ho 8 C 18.5 ns fv/lv t pixclkf_fvlv C2 0 2 ns t fvlv_su 8 C 18.5 ns t fvlv_ho 8 C 18.5 ns ext clk pixclk d out [7 :0] fram e_valid line_valid t pixclkf_dout t pixclkf_fvlv input output output output t fv lv_su t fv lv_ho t dout_ho t dout_su t extclk_period
mt9v128_ds rev. f pub. 5/15 en 70 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing slew rate figure 50: slew rate timing table 31: slew rate for pixclk and d out f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa = 2.8v; v ?? _pix = 2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v; t = 25c; c load = 40 pf pixclk d out [7:0] unit r0x30 [10:8] typical rise time typical fall time r0x30 [2:0] typical rise time typical fall time 000 6.5 6.3 000 6.5 6.3 ns 001 4.8 4.6 001 4.8 4.6 ns 010 3.9 3.8 010 3.9 3.8 ns 011 3.7 3.7 011 3.7 3.7 ns 100 3.6 3.6 100 3.6 3.6 ns 101 3.5 3.5 101 3.5 3.5 ns 110 3.4 3.4 110 3.4 3.4 ns 111 3.3 3.3 111 3.3 3.3 ns 90% 10% t rise t fa ll pixclk d out t rise t fa ll 90% 10%
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 71 ?semiconductor components industries, llc,2015. configuration timing during start-up, the dout_lsb0, lv and fv ar e sampled. setup and hold timing for the reset_bar signal with respect to d out _lsb0, lv, and fv are shown in figure 51 and table 35. these signals are sampled once by the on-chip firmware, which yields a long t hold time. figure 51: configuration timing table 32: configuration timing signal parameter min typ max unit d out _lsb0, frame_valid, line_valid t setup 0 ? s t hold 50 ? s t setup t hold valid data reset_bar d out _lsb0 frame_valid line_valid
mt9v128_ds rev. f pub. 5/15 en 72 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing figure 52: power up sequence notes: 1. reset_bar may not exceed v dd _io + 0.3v. 2. the 2.8v plane (v aa , vaa_pix, v dd _pll, v dd _dac, v dd _io) must remain at a higher voltage than the 1.8v core voltage at all times. notes: 1. xtal settling time is component-dependent (xtal, oscillator, etc) and usually takes about 10ms ~100ms. 2. hard reset time is the minimum time required after power rails are settled. ten clock cycles are required for the sensor itself, assuming all power rails are settled. in a circuit where hard reset is performed by the rc circuit, then the rc time must include the all power rail settle time and xtal 3. this is required to load necessa ry patches via flash mode (spi) or host mode (two-wire serial inter- face). loading time varies depending on the number of patches and bus speed. table 33: power up sequence definition symbol minimum typical maximum unit v dd _pll to v aa /vaa_pix t0 0 C C ? s v aa /vaa_pix to v dd _io t1 0 C C ? s v dd _io to v dd t2 0 C C ? s xtal settle time tx C 30 1 Cms hard reset t3 10 2 CCclock cycle internal initialization t4 50 C C ms patch load (spi or i 2 c) t5 C 400 3 Cms vdd (1.8) vaa_pix vaa (2.8) vdd_pll vdd_dac (2.8) extclk reset _bar vdd_io (2.8) t3 t4 t5 t0 t1 hard reset internal (ntsc/pal) initialization patch config spi or host streaming t2 tx
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 73 ?semiconductor components industries, llc,2015. figure 53: power down sequence (1) t3 is required between power down and next power up time, all decoupling caps from regulators must completely discharged before next power up. figure 54: frame_sync to frame_valid/line_valid table 34: power down sequence definition symbol minimum typical maximum unit v dd to v dd _io t0 0CC ? s v dd _io to v aa /v aa _pix t10CC ? s v aa /v aa _pix to v dd _pll/dac t20CC ? s power down until next power up time t3 100 1 CCms v dd (1.8) v aa _pix v aa (2.8) v dd _pll v dd _dac (2.8) extclk v dd _io (2.8) t3 t0 t2 t1 power down until next power up cycle frame_sync frame_valid line_valid t frame_sync t frmsynh_fvh
mt9v128_ds rev. f pub. 5/15 en 74 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing figure 55: reset to spi access delay figure 56: reset to serial access delay figure 57: reset to ae/awb image table 35: frame_sync to frame_valid/line_valid parameters parameter name conditions min typ max unit frame_sync to fv/lv t frmsync_fvh auto config mode 4 C C ms t frame_sync t framesync 30 ms r eset_bar t rsth_csl spi_cs_n reset_bar s data t rsth _ sdatal first frame overlay from flash reset_bar video t rsth_fvl t rsth_ovl t rsth_aeawb ae/awb settled
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor modes and timing mt9v128_ds rev. f pub. 5/15 en 75 ?semiconductor components industries, llc,2015. table 36: reset_bar delay parameters parameter name condition min typ max unit power up delay 2.8v to 1.8v 0.1 C C ms reset_bar high to spi_cs_n low trsth_csl 18 C C ms reset_bar high to s data low trsth_sdatal 1.8 C C ms reset_bar high to frame_valid trsth_fvl 235 C C ms reset_bar high to first overlay trsth_ovl 235 C C ms reset_bar high to ae/awb settled trsth_aeawb C 400 C ms
mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications mt9v128_ds rev. f pub. 5/15 en 76 ?semiconductor components industries, llc,2015. electrical specifications figure 58: spi output timing table 37: spi data setup and hold timing parameter description min typ max units f spi_sclk spi_sclk frequency 1.6875 4.5 18 mhz t su setup time C C 110 ns t sclk_sdo hold time 110 ns t cs_sclk delay from falling edge of spi_cs_ n to rising edge of spi_sclk C 230 C ns t su spi_cs_n spi_sclk spi_sdi spi_sdo t cs_sclk t sclk_sdo
mt9v128_ds rev. f pub. 5/15 en 77 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications caution stresses greater than those listed in table 41 may cause permanent damage to the device. this is a stress rating only, and functional ope ration of the device at these or any other con- ditions above those indicated in the operational sections of this specification is not implied. exposure to absolute maximum rating conditions for extended periods may affect reliabil- ity. notes: 1. v aa and v aa _pix must all be at the same potential to avoid excessive current draw. care must be taken to avoid excessive noise injection in the anal og supplies if all three supplies are tied together. 2. the imager operates in this temperature rang e, but image quality may degrade if it operates beyond the functional operating temperature range. 3. image quality is not guaranteed at temperat ures equal to or greater than this range. table 38: absolute maximum ratings symbol parameter rating unit min max v dd digital power (1.8v) -0.3 2.4 v v dd _io i/o power (2.8v) -0.3 4 v v aa v aa analog power (2.8v) -0.3 4 v vaa_pix pixel array power (2.8v) -0.3 4 v v dd _pll pll power (2.8v) -0.3 4 v v dd _dac dac power (2.8v) -0.3 4 v v in dc input voltage -0.3 v dd _io+0.3 v v out dc output voltage -0.3 v dd _io+0.3 v t stg storage temperature -50 150 c table 39: electrical characteristics and operating conditions parameter 1 condition min typ max unit core digital voltage (v dd ) C 1.7 1.8 1.9 v io digital voltage (v dd _io) C 2.66 2.8 2.94 v video dac voltage (v dd _dac) C 2.66 2.8 2.94 v pll voltage (v dd _pll) C 2.66 2.8 2.94 v analog voltage (v aa ) C 2.66 2.8 2.94 v pixel supply voltage (v aa _ pix) C 2.66 2.8 2.94 v leakage current extclk: high or low 10 ? a imager operating temperature 2 C C40 +105 c functional operating temperature 3 C40 +85 c storage temperature C C50 +150 c
mt9v128_ds rev. f pub. 5/15 en 78 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications table 40: video dac electrical characteristicsCsingle-ended mode f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa = 2.8v; v aa _pix = 2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v parameter condition min typ max unit resolution C 10 - bits dnl C 0.2 0.4 bits inl C 0.7 3.5 bits output local load output pad (dac_pos) C 75 - ? unused output (dac_neg) C 0 - ? output voltage single-ended mode, code 000h C .02 - v single-ended mode, code 3ffh C 1.30 - v output current single-ended mode, code 000h C 0.26 - ma single-ended mode, code 3ffh C 17.33 - ma supply current estimate C - 25.0 ma dac_ref dac reference C 1.15 +/-0.2 - v r dac_ref dac reference C 4.7 - k ? table 41: video dac electrical characteristicsCdifferential mode f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa = 2.8v; v aa _pix = 2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v parameter condition min typ max unit dnl C 0.2 0.25 bits inl C 0.8 2.5 bits output local load differential mode per pad (dac_pos and dac_neg) C 37.5 C ? output voltage differential mode, code 000h, pad dacp C .02 C v differential mode, code 000h, pad dacn C 1.30 C v differential mode, code 3ffh, pad dacp C 1.30 C v differential mode, code 3ffh, pad dacn C .02 C v output current differential mode, code 000h, pad dacp C .53 C ma differential mode, code 000h, pad dacn C 34.7 C ma differential mode, code 3ffh, pad dacp C 34.7 C ma differential mode, code 3ffh, pad dacn C .53 C ma differential output, midlevel C0.65Cv supply current estimate C C 50 ma dac_ref dac reference C 1.15 +/-0.2 v r dac_ref dac reference 2.35 k ?
mt9v128_ds rev. f pub. 5/15 en 79 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications notes: 1. all inputs are protected and may be active when all supplies (2.8v and 1.8v) are turned off. table 42: digital i/o parameters t a = ambient = 25c; all supplies at 2.8v signal parameter definitions condition min typ max unit all outputs load capacitance 1 C 30 pf output signal slew 2.8v, 30pf load C C C v/ns 2.8v, 5pf load C C C v/ns v oh output high voltage C v dd _io C v v ol output low voltage C0.3 C C v i oh output high current v dd = 2.8v, v oh = 2.4v CC 8ma i ol output low current v dd = 2.8v, v ol = 0.4v CC 8ma all inputs v ih input high voltage v dd = 2.8v 0.7 * v dd _io C v dd _io + 0.3 v v il input low voltage v dd = 2.8v C0.3 C 0.3 * v dd _io v i in input leakage current C2 C 2 ? a signal cap input signal capacitance C3.5 Cpf
mt9v128_ds rev. f pub. 5/15 en 80 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications power consumption, operating mode analog output uses single-ended mode: dac_pos = 75 ? , dac_neg = open, parallel output is disabled. analog output uses single-ended mode: dac_pos = 75 ? , dac_neg = open, parallel output is enabled. table 43: power consumption C condition 1 f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa =2.8v;v aa _pix=2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v power plane supply condition 1 typ power max power unit v dd 1.8 140.4 162 mw v dd _io 2.8 parallel off 4.2 8.4 mw v aa 2.8 89.6 112 mw vaa_pix 2.8 1.96 5.04 mw v dd _dac 2.8 single 75(1) 39.2 44.8 mw v dd _pll 2.8 13.44 16.8 mw total 288.8 349.04 mw table 44: power consumption C condition 2 f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa =2.8v;v aa _pix=2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v power plane supply condition 2 typ power max power unit v dd 1.8 140.4 162 mw v dd _io 2.8 parallel on 42 50.4 mw v aa 2.8 89.6 112 mw vaa_pix 2.8 1.96 5.04 mw v dd _dac 2.8 single 75(1) 39.2 44.8 mw v dd _pll 2.8 13.44 16.8 mw total 326.6 391.04 mw
mt9v128_ds rev. f pub. 5/15 en 81 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications ntsc signal parameters notes: 1. black and white levels are referenced to the blanking level. 2. ntsc convention standardized by the ire (1 ire = 7.14mv). 3. encoder contrast setting r0x011 = r0x001 = 0. 4. dac ref = 2.35k ? , load = 37.5 ?? table 45: ntsc signal parameters f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa = 2.8v; v aa _pix = 2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v parameter conditions min typ max units notes line frequency 15734.25 15734.27 15734.28 hz field frequency 59.94 59.94 59.94 hz sync rise time 148 148 148 ns sync fall time 148 148 148 ns sync width 4.74 4.74 4.74 ? s sync level 38 40 42 ire 2, 4 burst level 38 40 42 ire 2, 4 sync to setup (with pedestal off) 9.44 9.44 9.44 ? s sync to burst start 5.33 5.33 5.33 ? s front porch 1.33 1.33 1.33 ? s black level 7.5 ire 1, 2, 4 white level 100 ire 1, 2, 3, 4
mt9v128_ds rev. f pub. 5/15 en 82 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications figure 59: video timing table 46: video timing signal ntsc 27 mhz pal 27 mhz units a h period 1716 1728 clocks b hsync to burst 144 153 clocks c burst 63 66 clocks d hsync to signal 255 279 clocks e video signal 1423 1413 clocks ffront 3639clocks g hsync period 128 128 clocks h sync rising/falling edge 4 4 clocks j back overscan (bos) 9 14 clocks k front overscan (fos) 8 13 clocks h f a h de b c g j k
mt9v128_ds rev. f pub. 5/15 en 83 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications figure 60: equivalent pulse table 47: equivalent pulse signal ntsc 27 mhz pal 27 mhz units i h/2 period 858 864 clocks j pulse width 64 64 clocks k pulse rising/falling edge 4 4 clocks l signal to pulse 38 41 clocks l j i k k
mt9v128_ds rev. f pub. 5/15 en 84 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications figure 61: v pulse table 48: v pulse signal ntsc 27 mhz pal 27 mhz units m h/2 period 858 864 clocks n pulse width 730 736 clocks o v pulse interval 128 128 clocks p pulse rising/falling edge 4 4 clocks n m o p p
mt9v128_ds rev. f pub. 5/15 en 85 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor electrical specifications two-wire serial bus timing figure 62 and table 52 describe the timi ng for the two-wire serial interface. figure 62: two-wire serial bus timing parameters notes: 1. this table is based on i 2 c standard (v2.1 january 2000). philips semiconductor. 2. two-wire control is i 2 c-compatible. 3. all values referred to v ihmin = 0.9 v dd and v ilmax = 0.1v dd levels. sensor exclk = 27 mhz. 4. a device must internally provide a hold time of at least 300 ns for the s data signal to bridge the undefined region of the falling edge of s clk . 5. the maximum t hd;dat has only to be met if the device does not stretch the low period ( t low) of the s clk signal. table 49: two-wire seri al bus characteristics f extclk = 27 mhz; v dd = 1.8v; v dd _io = 2.8v; v aa = 2.8v; v aa _pix = 2.8v; v dd _pll = 2.8v; v dd _dac = 2.8v; t a = 25c parameter symbol standard-mode fast-mode unit min max min max s clk clock frequency f scl 0 100 0 400 khz hold time (repeated) start condition. after this period, the first clock pulse is generated t hd;sta 4.0 - 0.6 - ? s low period of the sclk clock t low 4.7 - 1.3 - ? s high period of the sclk clock t high 4.0 - 0.6 - ? s set-up time for a repeated start condition t su;sta 4.7 - 0.6 - ? s data hold time: t hd;dat 0 4 3.45 5 0 6 0.9 5 ? s data set-up time t su;dat 250 - 100 6 -ns rise time of both s data and s clk signals t r - 1000 20 + 0.1cb 7 300 ns fall time of both s data and s clk signals t f - 300 20 + 0.1cb 7 300 ns set-up time for stop condition t su;sto 4.0 - 0.6 - ? s bus free time between a stop and start condition t buf 4.7 - 1.3 - ? s capacitive load for each bus line cb - 400 - 400 pf serial interface input pin capacitance cin_si - 3.3 - 3.3 pf s data max load capacitance cload_sd - 30 - 30 pf s data pull-up resistor rsd 1.5 4.7 1.5 4.7 k ? s sr t su;sto t su;sta t hd;sta t high t low t su;dat t hd;dat t f s data s clk p s t buf t r t f t r t hd;sta
mt9v128_ds rev. f pub. 5/15 en 86 ?semiconductor components industries, llc,2015. mt9v128: 1/4-inch color cmos ntsc/pal digital image sensor spectral characteristics 6. a fast-mode i 2 c-bus device can be used in a standard-mode i 2 c-bus system, but the requirement t su;dat 250 ns must then be met. this will automa tically be the case if the device does not stretch the low period of the s clk signal. if such a device does stretch the low period of the s clk signal, it must output the next data bit to the s data line t r max + t su;dat = 1000 + 250 = 1250 ns (according to the standard-mode i 2 c-bus specification) before the s clk line is released. 7. cb = total capacitance of one bus line in pf. spectral characteristics figure 63: quantum efficiency 0 10 20 30 40 50 60 70 80 350 450 550 650 750 850 950 1050 1150 blue green (b) green (r) red quantum efficiency (%) wavelength (nm)
mt9v128_ds rev. f pub. 5/15 en 87 ?semiconductor components industries, llc,2015 mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor spectral characteristics package and die dimensions figure 64: 63-ball ibga package outline drawing
on semiconductor and the on logo are registered trademarks of semiconductor components industries, llc (scillc) or its subsidia ries in the united states and/or other countries. scillc owns the rights to a number of patents, trademarks, copyrights, trade secrets, and other intellectual property. a listing of scillcs pr oduct/patent coverage may be accessed at www.onsemi.com/site/pdf/ patent-marking.pdf. scillc reserves the right to make changes without further noti ce to any products herein. scillc makes no warranty, representat ion or guarantee regarding the suitability of its products for any particular purpose, nor does scillc assume any liability arising out of the application or use of any product or circuit, and specifically disclaim s any and all liability, including without limitation special, consequential or incidental damages. typical parameters which may be provided in scillc data shee ts and/or specifications can and do vary in different applications and actual performance may vary over time. all operating parameters, including typicals must be validated for each customer a pplication by customers technical experts. scillc does not convey any license under its patent rights nor the rights of others. sc illc products are not designed, intended, or authorized for use as components in systems intended for surgical implant into the body, or other applications intended to support or sustain life, or for any other application in whic h the failure of the scillc prod uct could create a situation where personal injury or death may occur. should buyer purchase or use scillc products for any such uninte nded or unauthorized applicatio n, buyer shall indemnify and hol d scillc and its officers, employ ees, subsidiaries, affiliates, and distributors harmless against all claims, costs, damages, and expenses, and reasonable attorney fees arising out of, directly o r indirectly, any claim of personal injury or death associated with such unintended or unauthorized use, even if such claim alleges that scillc was negligent regarding the design or manufacture of the part. scillc is an equal opportunity/affirmative action employer. this literature is subject to a ll applicable copyright laws and is not for resale in any manner. mt9v128:mt9v137: 1/4-inch color cmos ntsc/pal digital image sensor revision history mt9v128_ds rev. f pub. 5/15 en 88 ?semiconductor components industries, llc,2015 . revision history rev. f . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5/29/15 ? updated ?ordering information? on page 3 rev. e . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4/1/15 ? converted to on semiconductor template ? removed confidential marking rev. d . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5/17/12 ? updated trademarks ? applied updated aptina template rev. c . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7/15/10 ? updated figure 2: ?system block diagram,? on page 3 ? added paragraph after figure 3: ?using a crys tal instead of an external oscillator,? on page 4 ? updated figure 19: ?external overlay system block diagram,? on page 23 ? updated figure 39: ?single-ended termination,? on page 51 ? updated table 36, ?power up sequence,? on page 63 ? updated table 37, ?power down sequence,? on page 64 ? updated table 48, ?ntsc signal parameters,? on page 72 rev. b . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6/22/10 ? updated capacitor value in ?crystal usage? on page 4 ? updated note 4 in table 48, ?ntsc signal parameters,? on page 72 ? updated figure 62: ?two-wire serial bus timing parameters,? on page 76 ? updated table 52, ?two-wire serial bus characteristics,? on page 76 rev. a . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4/5/10 ?initial release

▲Up To Search▲

Price & Availability of MT9V128D00XTCK22BC1-200

	To Download MT9V128D00XTCK22BC1-200 Datasheet File
If you can't view the Datasheet, Please click here to try to view without PDF Reader .